13 Jobs in Beaverton, OR
BizTek People, Inc. | APA International Placement Consultants is Hiring a Data Engineer Near Beaverton, OR
Description
- The Data Engineer will collaborate with product owners, developers, database architects, data analysts, visual developers and data scientists on data initiatives and will ensure optimal data delivery and architecture is consistent throughout ongoing projects.
- Must be self-directed and comfortable supporting the data needs of the product roadmap. The right candidate will be excited by the prospect of optimizing and building integrated and aggregated data objects to architect and support our next generation of products and data initiatives.
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing for greater scalability.
- Comprehensive documentation and knowledge transfer to Production Support.
- Work with Production Support to analyze and fix Production issues.
- Participate in an Agile / Scrum methodology to deliver high -quality software releases every 2 weeks through Sprint
- Refine, plan stories and deliver timely.
- Analyze requirement documents and Source to target mapping.
Requirements
REQUIREMENTS
- 5 years’ experience in Big Data stack environments like AWS EMR, Clourdera, Hortonworks.
- 3 years of SPARK in batch mode.
- 3 years of experience in scripting using Python.
- 3 years of experience working on AWS Cloud environment.
- In-depth knowledge of Hive and S3.
- Strong understanding of Hadoop, MPP systems and data structures.
- Strong understanding of solution and technical design.
- Experience building cloud scalable high-performance data lake solutions.
- Experience with relational SQL & tools like Snowflake.
- Aware of Datawarehouse concepts.
- Performance tuning with large datasets.
- Experience with source control tools such as GitHub and related dev processes.
- Experience with workflow scheduling tools like Airflow.
- Strong problem solving and analytical mindset.
- Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders.
Top skills
- PySpark
- SQL
- Hadoop
Job Summary
Full Time
$109k-135k (estimate)
11/21/2023
05/11/2024
The job skills required for Data Engineer include SQL, Python, AWS, Data Warehouse, API, etc. Having related job skills and expertise will give you an advantage when applying to be a Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.
Similar Jobs
Popular Articles
